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Abstract. This document presents novel algorithms for detection of noisy and flick¬ 
ering pixels from Burst Alert telescope event data and subsequent elimination of 
data from such pixels to create a filtered event file. The approach adopted for this 
purpose is quite different from the current practises and focuses more on the tem¬ 
poral variation of data in the detector pixels over long intervals of time against the 
cun'ent algorithms which follow a pixel based approach. 
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Introduction 

Detection of Gamma Ray Bursts with BAT 0 comprises two steps, the detection of the 
onset of a burst by looking for surges in the event rate across the detector plane followed 
by the formation of an image of the sky using the events detected during the time interval 
at the beginning of the burst. However, owing to the presence of noisy and flickering 
pixels coupled with the presence of high background, the surges in the event rates in 
the detector plane can be overlooked and prevent detection of short Gamma Ray Bursts 
which don’t produce drastic increases in event rates. The event data when stripped of the 
contributions from such noisy and flickering pixels can facilitate the detection of shorter 
Gamma Ray Bursts. 


1. Detection of Noisy pixels 

7.7. Selection of Ideal Time Interval 

In order to facilitate faster computation, for event data files with exposure times greater 
that 7 Ks, the Ideal time interval needs to found out. However, for data sets with exposure 
time less than 7 Ks, the detection of flickering and noisy pixels can be carried out on the 
entire data set. An Ideal time interval may be defined as a time interval during which 
events have been reported on maximum number of pixels rather than being saturated over 
a particular cluster of pixels within the detector. 
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1.1.1. Algorithm for obtaining Ideal time interval from a given event file. 

1. Segregate the given data set into time intervals of IKs. Once done, we will have 
N data sets each comprising of event data for 

2. Define N matrices of size 286 x 173 (size of the detectorlfTl) each. The values of 
all the elements of the matrices should be assigned to 1. 

3. Scan each data set and once an event on a particular pixel has been encountered, 
increase the value of the corresponding matrix element by 1. This process has to 
be repeated for N data sets with N available matrices. 

4. For each matrix find the product of all the elements. The matrix with the maxi¬ 
mum value of the product corresponds to the data set contained by the ideal time 
interval. 

1.2. Implementation of Noise Removal Algorithm 

BAT images have noise characteristics different from most soft X-Ray images. It is worth 
noting that BAT images possess noise which follow Gaussian statistics fT]. Once the Ideal 
time interval for a particular event file has been identified, data from noisy pixels can be 
eliminated using the following algorithm. 

1.2.1. Algorithm for detection of data from noisy pixels. 

1. Consider the PHAfl] data contained within the ideal time interval for the given 
event file. Find the minimum and the maximum value of the PHA column within 
the given time interval. Find the difference between the minimum and the maxi¬ 
mum values. Let us assume this value to be N. 

2. Create a 2d array of size N x 2. The first column of the array should contain 
the PHA values in an ascending order while the second one should contain the 
no of pixels which contain that PHA value within the given time interval for a 
particular data set. Plot the first column on the X axis and the second one on the 
Y axis. This is similar to creating a histogram of the given data with N being the 
no of bins. 

3. Once plotted, we observe a peak following poisson statistics along with n other 
peaks following Gaussian statistics. As mentioned earlier noise in BAT follow 
Gaussian statistics. Thus, if we are able to get rid of these n Gaussian peaks, we 
can eliminate noise from the given data. 

The no of bins can be reduced to values around N/p , p being an integer to increase 
computation speed. Typically p can take values between 2 and 8, without compromising 
accuracy. 

1.2.2. Algorithm for eliminating data from noisy pixels. 

1. Select a range within the given set of PHA values which contains the n Gaussian 
peaks. Typical values of range may be from about 1% —40% of the maximum 
PHA value. It is also to be noted noise is mostly contained in the lower PHA 
channels. Hence it is not advisable to include very high PHA values in the range 
as it will lead to an increase in computation time which is undesirable. 


2. Scan the array created in the previous section within the given range of PHA 
values starting from the maximum value of the given range. Typically, the maxi¬ 
mum value of the range lies somewhere in the data which follow poisson statis¬ 
tics hence the value in the second column must decrease as we move towards the 
other end of the range. 

3. While scanning if a value is encountered which has more than xx f pixels as¬ 
sociated with it where f is the no of pixels associated with the previous value, 
then it can be considered as a beginning of a Gaussian peak. Typical values x lies 
between 1.01 and 1.6 depending upon the no of bins and the distribution of data. 

4. The end of the peak occurs when a value less than f has been encountered in the 
second column of the array. All the values between the beginning and end are 
flagged as noise and the PHA column in the data set is assigned with a dummy 
value D for all such values. D shouldn’t be any value present in the PHA column 
of the data set. 

5. This process is repeated n times until n Gaussian peaks have been removed. 



Figure 1. Histograms before and after the noise removal algorithm has been applied with N — 500 and D — 0 


2 . Detection of Flickering Pixels 

Pixels flicker at various timescales which make it difficult to detect 12. Thus flickering 
pixels can be detected at three timescales : fast (O.li), medium (li) and slow (lOi). At a 
given timescale, the following algorithm is applied. 

2.7. Algorithm for detecting flickering pixels 

1. Extract PHA v/s tim^ for a single pixel from a particular data set. 

2. Bin the data obtained at the selected timescale; ; fast (O.li), medium (li) and 
slow (10s). This gives us N independent bins. 

3. The mean (/r) and the standard deviation (o’) of the bins is found out. 


^The values in the data set which have been identified as data from noisy pixels need not be extracted as they 
have already been assigned with a dummy value. 












4. Select a threshold /r ±n x O’ depending upon the timescale. Typically the value of 
n can vary between 4 and 10 depending upon the timescale the flickering pixels 
are to be detected in. 

5. Define outlier bins as the ones which contains PHA values outside the given 
threshold. 

6. Sum up the values of the outlier bins. If this sum exceeds 1% of the sum of data 
in all the bins, the pixel must be flagged as flickering. 

7. Once a pixel is flagged as flickering, assign the contributions from that pixel to 
the data set with a Dummy value {D). This process is repeated for all the pixels. 


Results 


The given algorithm has been applied to a data set titled swQQ03Q352069bevshpo — 
uf.evt^ and the results have been plotted below. 
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Bin time: 0.5000 s 
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Figure 2. Light curves of the data before and after the algorithm has been applied with bin time = 0.5s 

On comparing the two plots we observe that there has been a decrease in the global 
count rate. Also on comparing the peaks present in both the figures, the peaks at Ri 1017s 
and Ri 1089s remains while others are no longer visible. Most note worthy is the peak ss 
1049s which is no longer visible. 

The approach that has been considered for this purpose is unlike the current 
BATHOTPIXUI algorithm in NASA’s HeasoftlH Software package which considers the 
behavior of a particular pixel w.r.t other pixels in the detector plane and completely ig¬ 
nores the behavior of such a pixel over long intervals of time. For example, a pixel which 
does falls into the hottest pixel category at a particular instant of time might not fall into 
the same category at a different instant, similarly, a pixel falling in the centermostlfTl 
portion of the histogram at a particular instant of time, might not belong to a similar 
category at another instant of time. Considering the temporal variation of counts in the 
pixels is of utmost necessity if data from noisy pixels are to be eliminated. 
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